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DETAILED ACTION 

1 . This action is responsive to communications: Application filed 1 0/26/00. 

2. Claims 1-37 are pending. Claims 1, 1 1, 16, 19, 22, 28, 32, 34, 36, and 37 are 
independent claims. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 1-7, 9-14, 16-17, 19-20, 22-24, 26-30, 32, and 36-37 are rejected under 
35 U.S.C. 103(a) as being unpatentable over Shaw et al. . US 6,151,598, 11/21/00 (filed 
12/4/97). 

In reference to claims 1, 16, 19, 22, 32, 34, and 36, Shaw teaches a digital 
dictionary with a communication system comprising the following features: 
-Displaying means for displaying multimedia information and related text. See figure 4 
and column 10, lines 13-21. Compare to "displaying means for displaying 
characters and images". 

-An inputting means for retrieving portions of text based documents. See column 9, 
lines 47-52 and column 10, lines 21-25. The inputting of text comprising transmission, 
processing, and display. Compare to "inputting means for inputting a character 
string in a document forming area in the display means". 
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-A storage means (multimedia database) having multimedia information. See figure 4 
and columns 9-10. Compare to "storage means having stored therein multimedia 
information . . ." 

-A means for producing multimedia information for the inputted text. See column 4, 
lines 42-48. A multimedia reference pointer that produces multimedia representations 
for the selected instances of alphabet, code, character, sign. See columns 9, lines 60- 
67 and column 10. Compare to "a word dictionary in which reading data is 
associated with a displayed character and further the reading data is associated 
with the multimedia information identifier representing the multimedia 
information to be displayed". 

-A Multimedia reference pointer which produces selective multimedia representation for 
the instances of the combination of characters. A referencing means which produces 
identification means for retrieval of multimedia representation for each instance of the 
text. See columns 9-10. "a multimedia information registration table in which a 
keyword associated with reading data in the word dictionary is associated with 
the multimedia information identifier. " 

-A Multimedia reference pointer which produces selective multimedia representation for 
the instances of the combination of characters. A referencing means which produces 
identification means for retrieval of multimedia representation for each instance of the 
text. See columns 9-10. A multimedia retrieval means which references the selective 
multimedia representation for each instance. A means to transmit, and display the 
multimedia information. See columns 9-10. Compare to "retrieving means for 
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executing forward coincidence retrieval . . .by said inputting means to another. . 
.if the multimedia identifier. . .display means as selectable conversion candidate 
data" 

Shaw teaches associating the multimedia information with each instance of the 
text combination; however, he does not state that he does this using a referencing table. 
One of ordinary skill in the art would recognize that a "referencing means which 
produces identification means for retrieval of multimedia representations for each 
instance of the text combination" serves the same purpose as a "registration table in 
which a keyword is associated with reading data . . .with the multimedia information 
identifier" in that it is able to associate the multimedia information with the related text. 
See columns 9-10 of Shaw. Thus it would have been obvious to a person of ordinary 
skill in the art at the time of the invention to utilize a registration table to display the 
associations of a multimedia information to the text as it is simply a means of 
association which is taught by Shaw. 

In reference to claim 2, Shaw teaches a means for producing multimedia 
information for the inputted text. See column 4, lines 42-48. He further discloses a 
multimedia reference pointer that produces multimedia representations for the selected 
instances of alphabet, code, character, sign. See columns 9, lines 60-67 and column 
10. Shaw teaches a Multimedia reference pointer which produces selective multimedia 
representation for the instances of the combination of characters. Shaw discloses a 
referencing means which produces identification means for retrieval of multimedia 
representation for each instance of the text. See columns 9-10. Shaw further teaches a 
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multimedia reference pointer which produces selective multimedia representation for the 
instances of the combination of characters. A referencing means which produces 
identification means for retrieval of multimedia representation for each instance of the 
text. See columns 9-10. A multimedia retrieval means which references the selective 
multimedia representation for each instance. A means to transmit, and display the 
multimedia information. See columns 9-10. 

Shaw teaches the use of a digital dictionary to communicate this information. 
One of ordinary skill in the art at the time of the invention would recognize that a 
combination of characters can develop a sentence, thus it would have been obvious for 
Shaw's system as discussed above and claim 1 to retrieve characters of a sentence 
that is associated with multimedia identifiers. See columns 9-10. 

In reference to claim 3, Shaw teaches a Multimedia reference pointer which 
produces selective multimedia representation for the instances of the combination of 
characters. A referencing means which produces identification means for retrieval of 
multimedia representation for each instance of the text. See columns 9-10. 
Furthermore, the referencing means includes a multimedia retrieval means for retrieving 
the multimedia from the storage. See column 10, lines 8-1 2. Shaw teaches associating 
the multimedia information with each instance of the text combination; however, he 
does not state that he does this using a referencing table. One of ordinary skill in the art 
would recognize that a "referencing means which produces identification means for 
retrieval of multimedia representations for each instance of the text combination" serves 
the same purpose as a "registration table in which a keyword is associated with reading 
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data . . .with the multimedia information identifier" in that it is able to associate the 
multimedia information with the related text. See columns 9-10 of Shaw. 

In reference to claim 4, Shaw teaches that the multimedia information can be 
stored in a multimedia database for access over the Internet. See columns 1 , 9, and 
10. 

In reference to claim 5, Shaw teaches a Multimedia reference pointer which 
produces selective multimedia representation for the instances of the combination of 
characters. A referencing means which produces identification means for retrieval of 
multimedia representation for each instance of the text. See columns 9-10. Shaw 
teaches associating the multimedia information with each instance of the text 
combination; however, he does not state that he does this using a referencing table. 
One of ordinary skill in the art would recognize that a "referencing means which 
produces identification means for retrieval of multimedia representations for each 
instance of the text combination" serves the same purpose as a "registration table in 
which a keyword is associated with reading data . . .with the multimedia information 
identifier" in that it is able to associate the multimedia information with the related text. 
See columns 9-10 of Shaw. 

In reference to claims 6 and 7, Shaw discloses a subject of interest selector 
which produces, preserves, and retrieves the combination of characters that would be of 
interest to a user. He also discloses the multimedia reference pointer that produces a 
representation for those combination of characters. It would have been obvious to one 
of ordinary skill in the art at the time of the invention to modify the subject of interest 
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selector such that different combination of texts would retrieve specific multimedia 
information as it allows a user to change and add content associated with different text. 

In reference to claims 9 and 10, Shaw teaches a multimedia reference pointer 
which produces selective multimedia representation for the instances of the combination 
of characters, a referencing means which produces identification means for retrieval of 
multimedia representation for each instance of the text. See columns 9-10. 
Furthermore, the referencing means includes a multimedia retrieval means for retrieving 
the multimedia from the storage. See column 10, lines 8-12. Shaw's system takes into 
consideration the entire combination or characters thus as characters are added to the 
sequence, multimedia data is retrieved according to the entire combination. It would 
have been obvious to one of ordinary skill in the art at the time of the invention that the 
selection is based on the entire word combination. As the combination changes, so do 
the multimedia associations. See columns 9-10. 

In reference to claim 17, Shaw teaches that the multimedia information can be 
stored in a multimedia database for access over the Internet. See columns 1 , 9, and 
10. 

In reference to claim 20, Shaw teaches that the multimedia information can be 
stored in a multimedia database for access over the Internet. See columns 1 , 9, and 
10. 

In reference to claim 23, Shaw's system teaches that certain combination of 
characters that are inputting through an inputting means will generate multimedia 
information based on a multimedia identifier contained in the dictionary. A multimedia 
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reference pointer produces selective multimedia representation for the instances of the 
combination of characters, a referencing means which produces identification means for 
retrieval of multimedia representation for each instance of the text. See columns 9-10. 

In reference to claim 24, Shaw teaches a multimedia reference pointer which 
produces selective multimedia representation for the instances of the combination of 
characters, a referencing means which produces identification means for retrieval of 
multimedia representation for each instance of the text. See columns 9-10. 
Furthermore, the referencing means includes a multimedia retrieval means for retrieving 
the multimedia from the storage. See column 10, lines 8-12. Shaw teaches associating 
the multimedia information with each instance of the text combination; however, he 
does not state that he does this using a referencing table. One of ordinary skill in the art 
would recognize that a "referencing means which produces identification means for 
retrieval of multimedia representations for each instance of the text combination" serves 
the same purpose as a "registration table in which a keyword is associated with reading 
data . . .with the multimedia information identifier" in that it is able to associate the 
multimedia information with the related text. See columns 9-10 of Shaw. 

In reference to claims 26 and 27, Shaw teaches a multimedia reference pointer 
which produces selective multimedia representation for the instances of the combination 
of characters, a referencing means which produces identification means for retrieval of 
multimedia representation for each instance of the text. See columns 9-10. 
Furthermore, the referencing means includes a multimedia retrieval means for retrieving 
the multimedia from the storage. See column 10, lines 8-12. Shaw's system takes into 
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consideration the entire combination or characters thus as characters are added to the 
sequence, multimedia data is retrieved according to the entire combination. It would 
have been obvious to one of ordinary skill in the art at the time of the invention that the 
selection is based on the entire word combination. As the combination changes, so do 
the multimedia associations. See columns 9-10. 

In reference to claims 1 1 , 28, and 37, Shaw teaches a digital dictionary with a 
communication system comprising the following features: 

-Displaying means for displaying multimedia information and related text. See figure 4 
and column 10, lines 13-21. Compare to "displaying means for displaying 
characters and images". 

-An inputting means for retrieving portions of text based documents. See column 9, 
lines 47-52 and column 10, lines 21-25. The inputting of text comprising transmission, 
processing, and display. Compare to "inputting means for inputting a character 
string in a document forming area in the display means". 
-A storage means (multimedia database) having multimedia information. See figure 4 
and columns 9-10. Compare to "storage means having stored therein multimedia 
information . . ." 

-A means for producing multimedia information for the inputted text. See column 4, 
lines 42-48. A multimedia reference pointer that produces multimedia representations 
for the selected instances of alphabet, code, character, sign. See columns 9, lines 60- 
67 and column 10. Compare to "a word dictionary in which reading data is 
associated with a displayed characters". 
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-A Multimedia reference pointer which produces selective multimedia representation for 
the instances of the combination of characters. A referencing means which produces 
identification means for retrieval of multimedia representation for each instance of the 
text. See columns 9-10. A multimedia retrieval means which references the selective 
multimedia representation for each instance. A means to transmit, and display the 
multimedia information. See columns 9-10. Compare to "dictionary retrieving means 
for executing forward coincidence retrieval. . .by said inputting means to 
another;" 

-A method of interconnecting a plurality of documents for efficient storage and retrieval 
wherein the document equipment includes a plurality of selective document database, 
transmission, storage, etc. The Multimedia reference pointer produces selective 
multimedia representation for the instances of the combination of characters. A 
referencing means produces identification means for retrieval of multimedia 
representation for each instance of the text. See columns 9-10. A multimedia retrieval 
means references the selective multimedia representation for each instance. A means 
to transmit, and display the multimedia information. See columns 9-10. 

Shaw teaches that a multimedia reference pointer produces selective multimedia 
representation for the instances of the combination of characters. In executing the 
retrieval based on the combination of characters and retrieving associated multimedia 
files, Shaw teaches a means of retrieving a file based on forward coincidence retrieval. 
It would be obvious to one of ordinary skill in the art at the time of the invention that a 
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multimedia representation is a file and the retrieval based on the instances of the 
combination of characters denotes forward coincidence retrieval. 

In reference to claim 12 and 29, it was well-known in the art at the time of the 
invention for processes to run simultaneously. 

In reference to claims 13 and 30, Shaw teaches the use of a digital dictionary 
which can maintain a single or plurality of vocabulary data structures. See abstract. 
Furthermore, it was well known in the art at the time of the invention for processes to 
run simultaneously. 

In reference to claim 14, Shaw teaches that the multimedia information can be 
stored in a multimedia database for access over the Internet. See columns 1 , 9, and 
10. 

5. Claims 8, 15, 18, 21, 25, 31, 33, and 35 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Shaw et al. , US 6,151,598, 11/21/00 (filed 12/4/97) in view of 
Izumi, US 6,219,021 B1, filed 7/29/98. 

In reference to claim 8, 18, 21, 25, 33, and 35, Shaw teaches a text input means 
(see figure 4) for storing the entire or partial contents of text based documents; 
however, he does not teach the feature of a pre-set display number for candidate data. 
Izumi teaches a display control device in which a display panel is displaying data 
containing textual, drawing, and other data. The user can pre-set the display sizes for 
the data to be displayed. See abstract and column 4, lines 9-16. It would have been 
obvious to a person of ordinary skill in the art at the time of the invention to implement 
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Izumi's pre-set display in the system of Shaw since it limits the amount of characters a 
user can input for which he seeks multimedia information. 

In reference to claims 1 5 and 31 , Shaw teaches a text input means (see figure 4) 
for storing the entire or partial contents of text based documents; however, he does not 
teach the feature of a pre-set display number for candidate data. Izumi teaches a 
display control device in which a display panel is displaying data containing textual, 
drawing, and other data. The user can pre-set the display sizes for the data to be 
displayed. See abstract and column 4, lines 9-16. It would have been obvious to a 
person of ordinary skill in the art at the time of the invention to implement Izumi's pre-set 
display in the system of Shaw since it limits the amount of characters a user can input 
for which he seeks multimedia information. 

Conclusion 

6. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Cannon et al. US 6,044,365 

Anderson et al. US 6,047,291 

7. Any inquiry concerning this communication from the examiner should be directed 
to Rachna Singh whose telephone number at 703.305.1952. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Joseph Feild can be reached on 703.305.9792. The fax phone number for 
the organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). ^ a 
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